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Abstract 

A reflection map, induced by the deterministic Skorohod problem 
on the nonnegative orthant, is applied to an R" valued function X on 
[0, oo) and then to a + X, where o is a nonnegative constant vector. 
An question that has been posed over 15 years ago is under what con- 
ditions the difference between the two resulting regulated functions 
converges to zero for any choice of a as time diverges. This in turn 
implies that if one imposes enough stochastic structure that ensures 
that the reflection map applied to a multidimensional process X con- 
verges in distribution, then it will also converge in distribution when it 
is applied to r] + X where rj is any almost surely finite valued random 
vector that may even depend on the process X. In this paper we ob- 
tain a useful equivalent characterization of this property. As a result 
we are able to identify a natural sufficient condition in terms of the 
given data X and the constant routing matrix. A similar necessary 
condition is also indicated. A particular implication of our analysis is 
that under additional stochastic assumptions, asymptotic irrelevance 
of the initial condition does not require the existence of a stationary 
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distribution. As immediate corollaries of our (and earlier) results we 
conclude that under the natural stability conditions, a reflected Levy 
process as well as Markov additive process has a unique stationary 
distribution and converges in distribution to this stationary distribu- 
tion for every initial condition. Extensions of the sufficient condition 
are then developed for reflection maps with drift and routing coeffi- 
cients that may be time and state dependent; some implications to 
multidimensional insurance models are briefly discussed. 

Keywords: Reflection mapping, reflected processes, Skorohod prob- 
lem, insensitivity to initial conditions, multidimensional Levy process, 
multidimensional Markov additive process, multidimensional insur- 
ance model, ruin problem. 
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1 Introduction and background 

Let X = {X{t)\ t > 0} be an valued cadlag (right continuous left limit) 
function, R = I — P^, where * denotes transposition and P is nonnegative 
with spectral radius less than one, that is, equivalently with P" — )■ as 
n — >■ oo. The matrix R is called an M-matrix (e.g., [3]). Consider 

W{X){t)^X{t) + RL{X){t) (1.1) 

where {W, L) is the unique (reflection) mapping of X satisfying for each 
i = 1, . . . , n: 

51 Li[X) is nondecreasing, nonnegative and right continuous. 

52 Wi{X) is nonnegative. 

53 /[o,oo) '^{Wi{x){t)>G}dLi{X){t) = 0. 

We note that this is also often referred to as a Skorohod problem in [0, oo)^ 
and from time to time this is what we will call it, especially in the setting 
of ( 1.2 ) below. It is mentioned in passing that in [9] an alternative but 
equivalent and somewhat more microscopic definition of the reflection map 
is given and it is shown that it is well defined under weaker conditions on X. 
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That is, the reflection map is weU defined even if X is not necessarily cadlag, 
but rather lower semicontinuous from the right. 

Now, with the current notations. Theorem 6 of [11] can be rephrased as 
follows. 

Theorem 1.1 Assume thatX^.X'^ are cadlag, X'^ — X^ is nonnegative and 
nondecreasing and denote X^ = X^ + RL {X^). Let e = (1, . . . , 1)*. Then 

(i) W (X^) (t) > W (X^) (t) for all t > 0. 

(ii) L (X^) = L {X^)—L (X^) (in particular nonnegative and nondecreasing) 

and is dominated above by {X'^ — X^). 

(iii) {W (X2) - W (Xi)) (resp. e* {W (X^) - W (X^)) ; is nonnegative 
and dominated above by (X^ — X^) (resp. e* (X^ — X^) ). 

(iv) When X^{t) = a + X^{t), where a is a nonnegative constant vector, 
then R-^ {W (X^) - W (X^)), hence e* {W (X^) - W (X^)), is nonin- 
creasing. 

It is mentioned that in [11] P was also assumed to be substochastic. 
However, it can easily be checked that this is not needed in the proofs hence 
Theorem 1.1 is valid without this additional restriction. In fact, in a much 
more general setting, similar results were obtained a few years later in The- 
orem 4.1 of [15]. In particular, the model considered there is of the form 

W{X){t) = X{t)+ [ b{u,L{X){u-),W{X){u-))du 

Jo 

(1.2) 

+ / R{u,L{X){u-),W{X){u-))dL{X){u) . 
J[o,t] 

where b and R satisfy certain regularity conditions. 

These results can be used, applying a Loynes' type argument, to estab- 
lish (see [11, 10]) that when X is a cadlag stochastic process having station- 
ary, ergodic (but not necessarily independent!) finite mean increments and 
R-^E{X{1) - X(0)) < 0, then W{X) is stable in the sense that it is tight 
and it has a stationary version. That is, there is a random vector ^ such 
that -|- X) is a stationary process. For the stationary version L(^ -|- X) 
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has stationary increments. Also, if in addition X{0) = 0, then W{X){t) 
is stochastically increasing in t, hence has a limiting distribution which co- 
incides with the distribution of + X){s) for each s. What is missing 
from this theory is what happens when X(0) is not zero. Does there exist a 
limiting distribution for any initial X{0)7 Does it depend on X{0)7 Is the 
stationary version unique? These questions are very relevant especially in 
the context queueing networks; sec [11, 10, 13] and references therein. 

In Section 2 of this paper we establish necessary and sufficient conditions 

for 

W{a + X){t)-W{X){t) ^0 (1.3) 

as t — )■ cxD for every nonnegative vector a. This problem was open [11, 13] 
for a while and its resolution also resolves the issues raised at the end of 
the last paragraph. Special cases are multidimensional Levy processes and 
multidimensional Markov additive processes with countable (or finite) state 
space modulation. See Theorem 2.10, Corollary 2.11 and Corollary 2.12 in 
what follows. 

In Section 3 we explore possible extensions for a more general set up. 
Regulated/ reflected processes constrained to stay in the nonnegative orthant 
with time and general space dependent coefficients (that is, with drift vector 
6(-) and refiection matrix R{-) depending on the variables {t,y,z) with the 
notations of Section 3) have been studied by various authors. In particular 
in the context of queueing networks and multidimensional insurance models. 
If the dispersion is constant, but the drift and reflection are not necessarily 
constant, solution to the stochastic problem can be obtained by solving the 
associated deterministic Skorohod problem path-by-path; so ( 1.2 ) has also 
received attention; see [7, 14, 15, 17] and references therein. In connection 
with insurance models, it has been argued in [16, 17] that non-constant drift 
and reflection arise in a natural fashion. 

In one dimensional actuarial risk theory, the ruin problem has a central 
role. Under certain natural conditions, it is known that the asymptotic nature 
of the ruin is the same or similar independent of the initial capital (see 
[8, 19]). It has been shown in [18] that the regulated process in the orthant 
hitting state is the appropriate notion of ruin for the multidimensional 
set up considered in [16, 17]. Extensions considered in Section 3 at the 
level of sample paths might hopefully lead to a better understanding of the 
multidimensional ruin problem; see Example 3.8. 
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We may now indicate how our work stands in relation to earlier studies. 
Asymptotic properties of constrained non-degenerate diffusion processes or 
jump- diffusion processes have been studied by many authors; see [2] for a 
fairly comprehensive list. As these processes are strong Markov and their 
infinitesimal generators are non-degenerate differential or integro-differential 
operators, appropriate Lyapunov functions, when they exist, can be used to 
establish existence of a unique stationary distribution independent of the ini- 
tial state or distribution. In our set up, such versatile tools are not available 
in general, as there may not even be an underlying probabilistic framework. 
Our main concern is the asymptotic pathwise irrelevance of the initial condi- 
tion. As will be seen below, if in addition a stochastic structure is imposed 
that guarantees existence of a stationary distribution, then uniqueness also 
follows. Insensitivity to the initial condition, however, can happen even when 
there is no stationary distribution; see Example 2.6. 

During the review process our attention has been drawn to [4, 5], where 
a problem similar to the one in Section 2 has been studied for reflected 
Brownian motion in a bounded planar domain with normal reflection at the 
boundary; see also [6] for an earlier work in that direction. Let f/( ■),[/(■) 
be reflected Brownian motions in a bounded domain D C with normal 
reflection starting respectively at x,x & D. Asymptotic behaviour of \U{t) — 
U{t)\ as i — >■ oo has been investigated in terms of nice geometric/ analytic 
properties related to the domain. The inflnitesimal generator in this case 
is the two dimensional Laplacian with Neumann boundary condition and 
the normalized Lebesgue measure is the stationary distribution. Tools from 
spectral theory of self-adjoint operators are used and beautiful connections 
with the geometry of D are elucidated in [4, 5, 6]. On the other hand, our 
investigation at the sample path level concerns oblique reflection as well, 
though restricted to a multidimensional orthant which is unbounded. Also, 
as mentioned earlier, our focus is on insensitivity to the initial state and that 
too at the level of sample paths. There need not even be any underlying 
probabilistic framework, let alone a stationary or a Markovian structure or 
associated mathematical machinery. As a consequence of our sample path 
results applied to stochastic processes, it turns out that insensitivity to the 
initial state can happen with probability one even in cases where the reflected 
process may be null recurrent or transient; see Example 2.6. A similar almost 
sure result is given in Example 2.7 for a non-Markovian process. 
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2 Main results 



It is reemphasized that due to Theorem 1.1, R~^{W{a + X) — W{X)) is 
nonincreasing and W{a + X) — W{X) is nonnegative and thus, as R has an 
inverse, namely R"^ — (X^i^o -P")*) the hmit of W{a+X)—W{X) necessarily 
exists and is finite. The question is whether it must be zero or not. 

For the case where the states 1, . . . ,n can be reordered in such a way 
that pij = for i > j, which is called a feedforward structure, the problem is 
relatively easy to solve. In this case, under appropriate natural conditions, 
there actually exists a finite coupling time from which the process that starts 
from zero and the one that starts from a become identical. See Theorem 4.1 
of [10] for details. Special cases are, of course, the one dimensional, tandem 
{pi,i+i = 1 for i = 1, . . . , n — 1) and parallel (P = 0) cases, which have been 
given special treatments in the literature, but are of no relevance to solving 
the general problem, hence references are omitted. 

Before we continue, we note that without loss of generality it may be 
assumed that pa — 0. The reason is that with D — diag (pn, . . . ,Pnn), 

W{X)^X + RL{X) (2.1) 

where Y = {I - D)-^/^Y ior Y = X,W, L and R = I - P with 

P ^ {I - D^/^iP - D){I - D^/^ (2.2) 

is nonnegative and has the same cigcnstructurc as P — D which is also non- 
negative and also has a spectral radius less than one, as it is bounded above 
by P. Note that since is bounded above by the diagonal of then 
necessarily pi^ < 1 for all i. 

The following is the main result of this paper. 

Theorem 2.1 For any given cddldg X and every i, the following conditions 
are equivalent: 

(i) \imt^^[Wi{a + X){t) - Wi{X){t)] = for all a > 0. 

(ii) limt_^oo Li{a + X){t) — oo for some a > 0. 

(iii) lim^^^oo Li{a + X){t) — oo for all a >0. 
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Proof: 

(ii)<^(iii) Obvious. 

(ii)=^(iii) Since 

R-^W{a + X) - R-^W{X) - R-^a + L{a + X) - L{X) , (2.3) 

by (ii) and (iv) of Theorem 1.1 note that 

L(a + X) <L{X) <L(a + X) + R-^a , (2.4) 

for all a > 0. Now, if (ii) holds for some a > 0, then by the left inequahty 
above it also holds for a = and by the right inequality it holds for all 
a > 0. 

(i)<S=(iii) Prom (i) and (iv) of Theorem 1.1 we have that W{a + X) > W{X) 
and, as discussed earlier, that 

\im{W(a + X)(t) -W(X)(t)) (2.5) 

t^oo 

exists. We denote this limit by and observe that it must be nonneg- 
ative. Assume that (i) does not hold, so that Q > for some a. Then 
there is some T such that ior t >T we have that 

Wi{a + X){t) - Wi{X){t) > ^ (2.6) 

and since Wi{X){t) > for alH > then in fact Wi{a + X){t) > Q/2 
for all t >T. Since l[Wi{a+x){t)>o}dLi{a + X){t) = it follows that 
Li{a + X)(t) = Li{a + X){T) for all t > T. This contradicts (iii) and 
thus (iii) implies (i). 

(i)=^(iii) Assume that (iii) does not hold and that, for some a > 0, Li{a+X) 
is bounded. Then from (ii)-^(iii) it follows that Li{X) is bounded, say, 
by 6 > 0. With being the unit vector with 1 in the ith coordinate 
and zero elsewhere, we have from (ii) of Theorem 1.1 that L{bei + X) < 
L{X) which imphes that 

0<Wi{X) = Xi + Li{X)-J2pj,Lj{X) 

j 

< Xi + b-J2PjiLj{bei + X) (2.7) 

j 

= {bei + X-P'L{bei + X))i 
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Recall that for cadlag y, L{Y) is the unique solution of the equations 



Lk{Ym 




inf [Yk{s)-J2PjkLj{Y){s)] AO 



j 



l<k<n, 
t > 0. 



(2.8) 



Set Y — bei + X, use the fact that pu = and the inequahty in ( 2.7 ) 
to conclude that Li{bei + X) = 0. For all c > 6 we also have from (ii) 
of Theorem 1.1 that L{cei + X) < L{bei +X) and in particular the ith 
coordinate is zero with both c and b. Thus, 



Therefore, subtracting and adding Wi{X) and letting i — > oo we have 



that CP - C > c - 6 > and (recall C'"' > 0) in particular > 



Remcirk 2.2 We note that we were not careful about assuming that X(0) = 
or even that -'^(O) > 0. This is because 



noting that if X(0) > then W{X){0) = X{0) and L{X){0) = 0. Thus 
Li{X) diverges if and only if Li{W{X){0) + X — X{0)) diverges and, by 
Theorem 2.1, if and only if Li{X — X{0)) diverges. Thus the equivalent 
conditions in Theorem 2.1 hold for X if and only if they hold for X — X{0). 
Also, this means that Theorem 2.1 implies that under either of its equivalent 
conditions, for every c, 6 > and even for every c, 6 e we have that 



Remark 2.3 In the same way that (ii)<(=^(iii) in Theorem 2.1, it is tempting 
to add a fourth equivalence according to which (i) holds for some (rather 
than all) a. This is, however false. For example, in one dimension with 
X{t) — — min(t, 1) we have that W{a + X){t) = max(a — min(t, 1),0). Thus, 
for a < 1 and t > a we have that W{a + X){t) = W{X){t) = 0, but if a > 1 
then W{a + X)(t) = a - 1 > for alH > 1 while W{X){t) = 0, so that (i) 
holds for < a < 1 but does not hold for a > 1. 



Wi{cei + X)-Wi{bei + X) 

^ c-b- Y.jPji{Lj{cei + X) - Lj{bei + X)) 
>c-b>0. 



which contradicts (i). 



L{X){t) - L{X){0) = L{W{X){0) + X- X{0)){t) , 



W{c + X){t) - W{b + X){t)^0 . 
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It is well known that if Y is nonnegative, nondecreasing right continuous 
and X + RY > then L{X) < Y. That is L{X) is the minimal nonnegative, 
nondecreasing right continuous process for which X + RL{X) > 0. Denote 

M,(X){t) = - inf (2.9) 

0<s<t 

N,{X){t) = - mUR-'X{s)); (2.10) 

0<s<t 

Theorem 4 of [11] is equivalent to N{X) < L{X) < R-^M{X). In addition, 
since 

< W{X) = X + RL{X) = X + L{X) - P^L{X) <X + L{X) (2.11) 

and since M is the minimal nonnegative nondecreasing process for which 
X + M{X) > 0, it follows that M{X) < L{X). Thus we have the following 
inequality for every i and every t: 

max(Mi(X), Ni{X)) < Li{X) < {R-^M{X))i (2.12) 

We thus obtain the following sufficient condition in terms of the given 
data X, P of the problem. 

Theorem 2.4 // either Mi{X) or Ni{X) is unbounded or equivalently if 

liminf Xi(i) = -oo (2.13) 

or 



\immi(R-^X(t))i^ -oo (2.14) 

t—^oo 

(respectively), then for every a > 

\im{Wi{a + X){t)-Wi{X){t))^0 (2.15) 

t— >-oo 

In a similar vein, we also have the following necessary condition: 
Theorem 2.5 If for every a > 

\im{Wi{a + X){t) - Wi{X){t)) = (2.16) 



t— >-oo 



then {R ^M{X))i is unbounded and, thus, Mj{X) is unbounded (that is, 
lim inf t_>oo (^) = —oo) for at least one j. 
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It may be noted that, when imposing stochastic assumptions, our asymp- 
totic results above do not require the existence of a stationary distribution. 
The following example illustrates this point. 

Example 2.6 Let X be a standard n-dimensional Brownian motion. Take 
R = I (equivalently, P = 0). It is well known that, almost surely (a.s.), 
lim inf t^oo Xi{t) = — oo for each 1 < i < n. Hence by Theorem 2.4, 
\imt^oo{W{a + X){t) - W{X){t)) = a.s., for each a > 0. It is known 
that the process W{X)(-) has no stationary probability distribution in this 
case; in fact, W{X) is transient for n > 3 and is null recurrent for n = 1, 2. 
As our conclusion is based on the sufficient condition in Theorem 2.4, it seems 
not to have been noticed earlier for reflected standard Brownian motion with 
normal reflection at the boundary. See also Example 3.7 . 

The next example shows that our approach does not require Markovian 
structure. 

Example 2.7 This example concerns n independent renewal risk processes. 
For i = 1, 2, . . . , n let 



where we make the following hypotheses: 

(H) (i) Q > is a constant for each i; (ii) {Ni{t) : t > 0}, {U^''^ : 
i>l},l<i,k<'n are independent families of random variables; (iii) for 
1 < i < n, A^j is a renewal counting process with positive intcr-renewal epochs 
(thus a.s. having flnitely many jumps on flnite time intervals); let A^^\i > 1 
denote the i.i.d. interarrival times of Ni with flnite positive expectation; 
(iv) for flxed k, uf'\l > 1 are i.i.d. positive random variables with flnite 
expectation. 

Hence, for a = (ai, . . . , a„), ai + Xi, . . . , a„ + X„ are n independent 
Sparre Andersen (or renewal risk) processes with respective initial capitals 
ai, . . . , Gn- Clearly, Xj, 1 < i < n are not Markovian in general. 

Denote X — (Xi, . . . , X„) and take R — I {P — 0). Then X^ are inde- 
pendent, so neither X nor W{a + X) are necessarily Markovian. 

In addition, suppose for 1 < i < n. 



Ni{t) 




(2.17) 



1 



E([/P). 



(2.18) 



£;(4'^) 
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Then using Theorem 6.3.1 of [19], we have for each i that, a.s. 



hmsupXj(t) = +00, hminf JY'j(t) 



= —00 



Hence by Theorem 2.4, \imt^^{W{a + X){t) - W{X){t)) = a.s., for 
each a > 0. See also Example 3.8. 

Remark 2.8 It is reasonable to conjecture that the sufficient conditions in 
Theorem 2.4 are also necessary. Unfortunately, this is not the case. Let 
us demonstrate this in a two dimensional setting. More precisely, consider a 

feedforward structure with P = ^ ^ ^ ^ , —Xi(t) = X2{t) = t\ sin(t)|. Then 

Li{X) = Mi{X) = iVi(X) is unbounded but M2{X) = 0. Also N2{X) = 
since Xi + X2 = 0. However 



as n ^ 00 and thus L2{X) is unbounded. Thus (i) of Theorem 2.1 holds for 
i — 1,2 but neither of the two sufficient conditions of Theorem 2.4 holds for 



Remark 2.9 Despite the previous remark, it is clear that in the one di- 
mensional case L{X) = M{X) = N{X) = R-^M{X) and thus for this 
case the condition that liminfi^oo ^{i) = is necessary and sufficient for 
W{a + X){t) - W{X){t) ^ as t 00 for all a > 0. This is, of course, 
obvious for other reasons as well since the ffist time that a + X(t) becomes 
negative is also a time where the processes W{a + X){t) and W{X)[t) couple 
(since both are zero). From this time and on they remain equal. 

We conclude this section with the following result concerning processes 
which arc of interest in queueing networks; see [12, 10, 11, 13] and references 
therein. A process X is said to have stationary increments (in the strong 
sense) if the law of {X{s + t)^ t > 0} is independent of s. 

Theorem 2.10 Let X be a cddldg valued stochastic process having sta- 
tionary increments. If for its two sided extension (see [11]) the limit ^ = 



L2{X){27rn) 



= - inf {X2{s) - MX){s)) 

0<s<27rn 

> Li{X){2Tm) - X{2nn) 
= Li(A:)(27rn) 00 



(2.19) 



i = 2. 
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lim(_^_oo exists, is constant and is finite (in particular when X also 

has ergodic increments, E\X{1) — X{0)\ < oo and then ^ = E{X{1) —X{0))) 
and if in addition the stability condition R~^^ < holds (coordinate-wise) , 
then 

(i) W{X){t) converges in distribution and moreover, for every a.s. finite 

random vector ^, + X){t) converges in distribution to the same 

limit. That is, the limiting distribution is independent of initial condi- 
tions. 

(ii) W{X) has a unique stationary version, in the sense that if, for^ andrj, 

+ X) and W{r) + X) are stationary, then the processes + X) 
and W{r)-\-X) are identically distributed. For each t the distribution of 
this stationary version coincides with the limiting distribution from (i). 

(iii) Denote Xs{-) = X{s -\- ■) — X{s). There is a uniquely distributed 
pair {^,Xo) (^ is a random vector and Xq is a process) such that 
{W -\- Xo){s) , Xg) is distributed like Xq) for each s > 0. Moreover, 
denoting Ws{Y){t) = W(r){t+s) andL,{Y){t) = L{Y){s+t)-L{Y){s) 
we have that the triplet of processes {Ws{C,+ Xq), Ls{C,+ Xq), Xg) is dis- 
tributed like {W{i + Xo), L{i + Xo), Xo). In particular W{i + Xq) is 
stationary and + Xq) has stationary increments. 

(iv) If in addition J is such that with Js(-) = J(-+s) we have that (X^, Jg) ~ 
(Xq, J) (in particular J is stationary andX has stationary increments), 
then 

(i-J) For every a.s. finite C^, {W{C, + X),J) converges in distribution 
to a limit which is independent of ^. 

(ii-J) {W{X), J) has a unique stationary version. 

(iii-J There is a uniquely distributed triplet Xq, J) such that {W{C,+ 
Xo){s), Xg, Jg) is distributed like (^^,^0, J) for each s > 0. More- 
over (Ws{^ + Xo), Lg(^ + Xo), Xs, Jg) is distributed like (W(^ + 
Xo),L(e + Xo),Xo,J). 

Proof: 

(i) A direct consequence of [11, 10] and Theorem 2.4 above. 
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(ii) Assume that for some ^ and t] both + X) and W{r] + X) are 
stationary processes. Then, ior < ti < . . . < and s > 0, 

{W{^ + X){t^), ...,W{^ + X){tJ) (2.20) 

is distributed hke 

{W{C + X){h + s),...,W{C + X){tm + s)) (2.21) 
with a similar statement when we replace ^ by r^. Clearly, 

{W{^ + X){U + s),...,W{i + X){t„, + s)) (2.22) 

converges in distribution as s — )■ oo (as its distribution is independent 
of s) and the same with rj. According to our results, the difference 
between 

{W{^ + X){h + s),...,W{^ + X){tm + s)) (2.23) 

and 

{W{r] + X)(ii + s), . . . , iy(77 + X){tm + s)) (2.24) 

converges to zero (coordinate wise, hence in any reasonable norm). 
Thus these limiting distributions must be the same and thus 

(W{i + X)(ti), ....W{i + X){tm)) (2.25) 

and 

{W{ii + X)(ii), ...,W{r] + X)(U) (2.26) 
are identically distributed. 

(iii) As was shown in [11], Xq can be extended to a two sided process, that 
is, with t G M rather than t > 0. So assume that Xo is aheady such. 
It was also shown there that W{X_s){s) is distributed like W{X){s), 
is nondecreasing in s and, with the current assumptions, the limit of 
W{X_s){s) is a.s. finite. Denote this limit by W*. Clearly for every 
< ^1 < . . . < we have that, a.s., 

{W{X_s){s),Xo{h), Xoitm)) ^ (W*, Xoih), Xoitm)) (2.27) 

and thus, upon shifting forward by s (that is replacing Xq by Xg and 
X_s by Xq) we have by the stationary increments property of X that 

{W{Xo)is),X,{t,), X,{tm)) {W*, Xoih), Xoitm)) ■ (2.28) 
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From our main result it follows that for every a.s. finite ^ we have that 
{W{^ + Xo){s) - W{Xq){s)) a.s. and thus the difference between 
(iy(e + Xo)(s),X,(ti), . . . ,X,(t„)) and (W^(Xo)(s), . . . 

a.s. vanishes as well. Therefore, it also follows that 

(WiC + Xo){s),X,{h), X,{tm)) {W*, Xoih), Xoitm)) • 

(2.29) 

Hence, if C, is such that {W{C, + Xq){s), Xg) is distributed like {^,Xq) 
then {W{^ + Xo)(s), . . . , X,(t^)) is distributed like 

(^, Xo{ti), . . . , Xo(tjn)): so that necessarily 

(^, Xoih), Xo{tm)) - {W*, Xoih), Xo{tm)) , (2.30) 

as required. Finally, since 

Wsi^ + Xo){t) = W{i + Xo){s + t) = W{W{i + Xo){s)+Xs){t) (2.31) 
and similarly 

L,(e + Xo){t) = L{W{^ + Xo){s) + Xs){t) (2.32) 

we have that 

{W,{C + Xo),L,{C + Xo),X,) 

(2.33) 

= {W{W{C + Xo){s) + X,), L{W{i + Xo){s) + X,), X,) 

and, as {W {^ + Xq){s), Xg) ~ ({, Xq), the right hand side is distributed 
like {W{^ + Xo), + Xq), Xq) as required. 

(iv) A trivial modification of the proofs of (i) — (iii) and is thus omitted. ■ 

Corollary 2.11 If X is a multidimensional Levy process with X(0) = 0, 
£^|X(1)| < oo and R~^EX{1) < (coordinate-wise), then the Markov process 
W{X) has a (unique) stationary distribution and converges in distribution 
to this stationary distribution for every (a.s. finite) initial condition. 

We should be careful to note that we did not show positive Harris recur- 
rence here, but 'only' that the nice properties of Harris processes hold. Even 
this, until now was an open question with the exception of some special cases, 
such as reflected Brownian motion and for Levy processes for the special case 
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where the inputs are nondecreasing and are independent, or when the P is of 
feedforward type. In the Levy case, see, e.g., [12, 10]. Thus an open problem 
mentioned in the first paragraph of [13] is resolved; see also [11]. 

We conclude this section with a result involving Markov additive pro- 
cesses with irreducible, positive recurrent countable state Markov modula- 
tion. These processes can be intuitively thought of as follows. There is an 
irreducible, positive recurrent countable state space continuous time Markov 
chain J with rate transition matrix Q and stationary distribution vector tt. 
When in state i, the additive part X behaves like a Levy process with charac- 
teristic triplet (cj, Ej, i/j), where Cj e IR", Ej is symmetric positive semidefinite 
and i/i is a (Levy) measure with Jjg„ min(||x|p, < oo. In addition, 

when J changes states from i to j, there are independent jumps (vector val- 
ued, possibly a.s. zero) with distribution Gij, where Ga is the distribution 
of the constant vector zero. For a more precise description for the one di- 
mensional case with finite state space modulation, see for example [1]. The 
multidimensional analogue as well as the countable state space case is defined 
in an identical manner. 

It is a basic fact that J may be coupled in a.s. finite time r with its 
stationary version. Denoting Xs{-) = X{s + ■) ~ ^i^) ^'^^ •^s(') = + ")' 
we have that (X(r + t),J{T + t)) = (X(r) + Xr{t), Jr{t)) and by the strong 
Markov property also that {X^-, J^) is a Markov additive process with (jointly) 
stationary and X^. having stationary increments. Note that this implies 
that if {W{a + X^){t)-W{X^){t)) a.s. for every a, then also {W{X{t) + 
Xr){t),Jr{t)) - {W{^ + Xrit)),Jrit)) ^ whcrc by (iv) of Theorem 2.10 
there is a ^ for which {W{^ + Xr){t), Jr(^)) is stationary. Thus the following 
is immediate. 

Corollary 2.12 Let {X, J) be a multi- dimensional Markov additive process 
(see above) where J is an irreducible, positive recurrent countable (or finite) 
state space continuous time Markov chain with rate transition matrix Q and 
stationary vector tt. Assume that J^^^^^^^ ||x||i/i(dx) < oo and \\x\\Gij{dx) < 
oo for all i (finite moment conditions). Denote pi — Ci-\- j^^^^^^^xyi{dx) e 
and /lij — J^xGij{dx) e R". Finally, denote 



(so that X{t)/t — >■ p a.s.) and assume that R ^p < 0. Then the Markov 




(2.34) 
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process {W{X), J) has a unique stationary distribution and converges to this 
stationary distribution for every initial condition. 

We mention that pi is the rate of the Levy process when J is in state i. A 
special case of this is, of course, finite state space Markov modulated (multi- 
dimensional) reflected Brownian motion with drifts and covariance matrices 
(/Xj, Ej). In this case p^Y^i '^il^i- 

3 Extensions 

In this section we consider extensions of Theorem 2.4 to some cases when the 
drift b and the reflection matrix R need not be constants. As mentioned in 
Section 1, the Skorohod problem with nonconstant drift and reflection has 
been studied by many authors in diverse contexts. 

We first describe the set-up. Let (t, w) t— )■ w) be an ]R"-valued 

function and (t, w) ^ P{t, i, w) he a.nnxn matrix valued function, where 
£ e R" and w e are all nonnegative. We denote by bi the ith coordinate 
of b and by Pij the i,jth coordinate of P. Finally, let it! = / — P*. In this 
section, we assume the following conditions. 

(Al) 6, P are bounded, continuous, Lipschitz continuous in {£, w) coordinate- 
wise uniformly in t, pij > and pa = 0. 

(A2) Denoting Tiij = sup^ £, w) (note that tth = 0) and setting 

n = (vTij), we assume that the spectral radius of 11 is strictly less 
than 1. We term this a uniform spectral radius condition. 

(A3) b, R are coordinate- wise, nonincreasing in i and nondecreasing in w. 

Under (Al) and (A2) one can prove (see, e.g., [15] and references therein) 
that for each cadlag X, there exists a unique pair {W{X), L{X)) satisfying 
( 1.2 ) and conditions S1-S3 (see Section 1). 

In this section, the notation W{a + X),L{a + X) becomes a bit cum- 
bersome and thus, from here on we will abbreviate it using the notation 
= W{a + X) and L« = L{a + X). In particular, W° = W{X) and 

= L{X). 

If (A1)-(A3) hold, then W > L"" < and L''{t2) - L'^(ti) < 
L°(t2) - L^{ti) for ti < t2. See Theorems 3.7 and 4.1 of [15]. 
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Lemma 3.1 (i) Assume (Al)-(A3). Let 1 < i < n. Put 

Pi{s) = sup{bi{s,0,w) ■.w>0}, s > 0. (3.1) 

Suppose 

\imM[Xi{t)+ [ pi{s)ds] = -oo. (3.2) 

t^OO Jq 

Then for any a >0 

lim^it) = +00. (3.3) 



(a) Let (A1)-(A3) hold In addition, let R he a constant matrix. Let 
l<i<n. Put 

^i{s) = sup{(i?-^6)i(s,0,'u;) : w > 0}, s > 0. (3.4) 
Suppose (3.2) or 

\immi[{R-^X)i{t)+ f ^i{s)ds] = -oo, (3.5) 

hold. Then (3.3) holds for any a > 0. 

Proof:(i) By (A3) note that 6i(s, L"(s), W^s)) < bi{s, 0, Wis)) < A(s)- 
Therefore, as Pij > 0, i 7^ j, using (A3), ( 1.2 ) it is easy to get 

> -ai-[Xi{t)+ [ Piis)ds], t>0. (3.6) 
Jo 

As L" is nondecreasing, l.h.s. of (3.3) makes sense; now (3. 2), (3. 6) imply 
(3.3). 

(ii) Because of part (i) we need to consider only the case when (3.5) holds. 
As is a constant, by ( 1.2 ) 

L^it) = R-^W%t)-R-^a-R-^X{t)- [ R-^b{s, L%s),W%s))ds. 

Jo 

Since R~^ is nonnegative, as in part (i) we have 

> -{R-'a)i-[{R-'XUt)+ f $i{s)ds], t>0. (3.7) 

Jo 

Use (3.5), (3.7) now to get (3.3). ■ 

We take a closer look at two situations. The first one concerns the case 
when the coefficients do not depend on the space variables. 
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Proposition 3.2 Let b,R be functions only of the time variable, satisfying 
(A1)-(A3). Then for any a > 0, limt^oo[M^"(^) - W^{t)] exists and belongs 
to [0,oo)"; that is, (2.5) holds. 

Proof: Let IT be the n x n constant matrix as in (A2) witli nonnegative 
entries. Note tliat R{s) = I — P^{s), s > 0; also 11 — P*(s) has nonnegative 
entries. Consequently 

{i-u)-'R{s) = (j + n + n^ + ...)(/ -p*(s)) 

oo 

= / + ^n^(n-p*(s)) (3.8) 

k=0 

is a matrix with nonnegative entries. As the coefficients depend only on the 
time variable, for any a > 0, 

{I -U)-^[W''{t)-W\t)] 

= (7-n)-^a+ / (7-n)-^i?(s)d(L"-L°)(s). (3.9) 
J{o,t] 

Because of (A3), we know that d{L^ - L^) < 0. Hence by (3.8), (3.9) it 
now follows that (/ — n)~^[W^"(t) — W^*^(t)] is nonincreasing in t; cf. (iv) of 
Theorem 1.1 above. As W"' — is nonnegative, the required conclusion 
now follows. ■ 
In view of Lemma 3.1, Proposition 3.2 and the proof of (iii)=^(i) in The- 
orem 2.1, the following result is now immediate. 

Theorem 3.3 Let (Al)-(A3) hold; in addition let b,R be functions only of 
the time variable. Suppose 

limmi[Xi{t)+ [ bi{s)ds] = -oo, l<i<n. (3.10) 

Then 



\iui[W^{t) - W'^it)] = 



for any a> 0. 



Note: In addition to the hypotheses of the above theorem, suppose R 
is a constant. Then, because of part (ii) of Lemma 3.1, for the theorem to 
hold, we need only to assume that for each i, either (3.10) holds or 

\immi[{R-^X)i{t) + / {R-^b)i{s)ds] = -oo. 
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The other situation we consider concerns the special case of feedforward 
structure. We need some notations. For fixed k = 1,2, ■■ ■ ,n, vector x — 
(xi, ■ ■ ■ , XnY, matrix A = {{Aij))i<ij<n denote X[k] = {xi, X2, ■ ■ ■ , XkY, A[k] = 
{{Aij))i<ij<k; if X is an M"-valued function, then X^^.] = (-^i, • " " ^XkY;. 
The following assumption is characteristic of the feedforward structure in 
our context. 

(Bl) For each 1 < i < n, Rij = if j > i, Ra = 1; Rij{s,i,w) — 
Rij{s,i[i\,W[i\) if j < i, bi{s,£,w) = bi{s,£[ii,W[ii) for s >0,i,w >0. 

So bi, Ri. do not depend on ££,Wi, £ > i. Recalling that R = I — P^, note 
that Pij = 0,j< i. 

In this context, note that the so called Skorohod equation ( 1.2 ) becomes 
for 1 < i < n 

Wm = a, + X,{t)+ fk{s,Ll^{s-),W^]{s-))ds + mt) 

Jo 

+ R^As,^^l{s-),W^J{s-))dL^J{s). (3.11) 

Fix k G {1,2,---}. Note that Lj'j.j, Wy^-^ are functions taking value in R*^ with 
L« j(0) = 0, W^[^](0) = a[fe]. By (3.11) it follows that 

W^,^{t) = + X^k]{t) + f &[,](., Lf,](.-), W^,^{s-))ds 

Jo 

+ f R^k]{s,%{s-),W^,^{s-))dL^,^{s). (3.12) 

Clearly {L^k])i ~ nondecreasing and can increase only when (Vrj^j)^ = 

— 0, 1 < i < k. Summarizing the above and also using uniqueness, we 
get the following. 

Proposition 3.4 Let (A1)-(A3),(B1) hold. Let a > 0. Let L", VT" he the 
solution pair for the Skorohod problem in [0, oo)**, corresponding to (a + 
X,b,R). Fix 1 < k < n. Then Lj'^pl^j^j is the unique solution pair for the 
Skorohod problem in [0, oo)'^ corresponding to {a[k] + X[k], b[k], R[k])- 

For our next result we need one more hypothesis. 

(B2) Coefficients b, R are independent of the |/-variables. 
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Proposition 3.5 Let (Al)-(A3),(B1)-(B2) hold. Let a > 0. Assume that 
(3.3) holds for all 1 < i < n. Then there is T >0 such that 

L'^it) - L^iT) = L^{t)-L^{T), t>T, (3.13) 
W^'it) = W°(t), t>T. (3.14) 

Proof: Note that it is cnougli to prove the following: for fixed i € 
{1, 2, ■ ■ ■ ,n} there exists > such that 

L^^it) - Ll^it,) = L°](i)-L°](iO, t>t,, (3.15) 
W^](t) = W^^it), t>t,. (3.16) 

Then one can take i = n,r = i„ in (3. 15), (3. 16) to get (3. 13), (3. 14). 

As (3.3) holds for i = 1, there is i > such that L^{t) > L?(0) = 0. Since 
L" can increase only when — 0, there is ti > such that IVf (ti) = 0, 
and hence W^{ti) = because of (A3). By (B1),(B2) clearly R^j = 0,j > 2, 
bi{s,i,w) = bi{s,W[i]) where bi is an appropriate function. Put X[i]{t) = 

X[i](t) -X[i](tO, ^fi](t) = Lf,](t) -L|\](ti), 4°Ht) = 4](t) -4](ti),t > tl. 
Hence ( 1.2 ) for i = 1 now implies 

W^^{t)^0 + Xii^{t)+ fh{s,W^^{s-))ds + ^^{t), t>ti, 

iy5](t) = + X[i](t)+ fhis,W^,]{s-))ds + L\^l{t), t>t,. 

Using the above it is not difficult to see that {(L|\](t), l^["j(i)) : i > ii} as well 
as {(Z|°j^(t), VF['J](t)) : t > ii} are both solution pairs to Skorohod problem in 

[0, oo) corresponding to (0 + b[i], i?[i]) for t > ti. By uniqueness, we see 
that (3. 15), (3.16) hold for i = 1. 

We now assume that (3. 15), (3. 16) hold for i = 1,2, ■ ■ ■ , k — 1 where k < n. 
We will now show that they hold for i = k as well. Without loss of generality 
we may take < ti < t2 < ■ ■ ■ < tfc-i < oo. Since (3.3) holds for i = A; 
note that there is t > tk-i such that Ll{t) > Ll(tk-i) > 0. So there exists 
tk > tk-i such that W^{tk) = 0, and hence Wj^{tk) = 0. As (3.16) holds 
for i = /c - 1, we now have W^l^itk) = W^[°](tfc) = C[fc], say. Put Xik]{t) = 
X[,](t)-X[fc](4), Lf,](t)^= Lf,](t)-Lf,](4), L[°f(t) = Lf,j(t)-Lf,](ife),t > 4. 
By Proposition 3.4, {{L'^^{t),W^f^-^{t)) : t > tk} is the solution pair for the 
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Skorohod problem in [0, oo)'^ corresponding to (C[fc] + X^^^, b[k], R[k])- By (B2) 
note that b[k]{s,i[k],wik]) = bik]{s,W[k]), R[k]{s, i[k],wik]) = R[k]{s,W[k]), where 
b[k],R[k] are appropriate functions on [0, oo)*^"*"^. So using (3.12) we get for 
t>tk 

W^,]{t) = C[.] + X[k]it) + r 6[.](., Lf,](.-) + Lf,](t,), W^,^is-))ds 

+ / R[k^{s,L^k]{s-)+%itk),W^k]{s-))dLl,^{s) 
J{tk,t] 

= C[k]+Xik]{t)+ [ b^k]{s,W^k]is-))ds 

+ [ R[k](s,W^,](s-))dL^,^{s). (3.17) 
J{tk,t] 

In a similar fashion we get for t >tk 

WS,]{t) = C[k] + X^k]{t)+ fh]is,WS,]{s-))ds 

+ f %](5,iyJ](.-))dL[°J(s). (3.18) 

Using (3.17), (3. 18) it can be seen that {{L^^^{t),W^^^{t)) : t > tk} as well as 

{(Zj°j(t), iyj°j(t)) : t > tk} are both solution pairs for Skorohod problem in 

[0, oo)^ corresponding to {([k] + ^[fc], ^[fc], -R[fc]) for t > tk] the other require- 
ments are very easy to check. By uniqueness it now follows that (3. 15), (3. 16) 
hold for i = A;, completing the proof. ■ 
Putting together Lemma 3.1 and Proposition 3.5 we get the following 
generalization of Theorem 4.1 of [10]. 

Theorem 3.6 (i) Assume (A1)-(A3),(B1),(B2). Suppose (3.2) holds, where 
/3i is given by (3.1), for each 1 < i < n. Then for any a > there is T > 
such that Wit) = W°{t), t > T. In paHicular limt_,oo[W^"(i) - W°{t)] = 
for any a > 0. 

(ii) In addition to the hypotheses in (i), let R he a constant matrix. Sup- 
pose for each 1 < i < n, at least one among (3. 2), (3. 5) hold. Then the 
conclusions of part (i) remain valid. 



21 



Example 3.7 As in Example 2.6 let X be a standard n-dimensional Brow- 

nian motion and take R = I. Then by Theorem 3.5, for any a > there is 
T > (depending on a and the sample path) such that W^"(t) = W^{t),t > T. 
So W"" and couple in finite time. It may be noted that earlier results on 
coupling of reflected Brownian motion in the orthant did not cover the case of 
reflected Brownian motion with zero mean and with normal reflection at the 
boundary, as the conditions required were stronger. (This example may be 
contrasted with the result in [6], which says that the reflected Brownian mo- 
tions in a planar bounded convex domain (whose curvature is bounded away 
0) with normal reflection, starting from two different points, never couple in 
flnite time, though the distance between them converges to zero). 

The next example includes also the case of mean zero and normal reflec- 
tion as in Example 2.7. 

Example 3.8 Let X — (Xi, .... X„) where Xi,l < i < n arc n independent 
renewal risk processes starting at as in Example 2.7. Let b,R satisfy the 
hypotheses of Theorem 3.6(i). For a > let PF"(-,a;) denote the regulated/ 
reflected process in the orthant corresponding to a + X with coefficients 6, R. 
As 6, R do not depend on the y- variables, note that (see Section 6 of [15]) 
W"' is a strong Markov process. So by Theorem 3.6(i), for any a > 0, there 
is an almost surely finite stopping time T such that W^"(t) = W^{t) for all 
t > T; in other words W"' and couple in finite time with probability one. 
This has the following imphcation of interest in actuarial risk theory. Let 
= inf{t > : W°-{t) — 0} denote the first hitting time of state 0; it is the 
ruin time (see [18]) for the multidimensional process W"'. Suppose < oo 
with probability one. Then by the strong Markov property it follows that 
visits the state infinitely often with probability one. Consequently, for 
any a > 0, as and couple in finite time with probability one we have 
r" < oo with probability one. 

A crucial ingredient in the proofs of Theorems 2.4, 3.3 is that 

lim [W''(t)-W%t)] 

exists and belongs to the nonnegative orthant. In Theorem 3.6 this conclusion 
is a byproduct of the coupling. So we end with the question: Is there an 
analogue of Proposition 3.2 for more general coefficients b, Rl 
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